frames,reward,visited_rooms,learned_transitions
0,0.0,0,0.0
